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1. A user interface for inserting a custom algorithm in a data- 
mining application, the user interface comprising: 

a control to upload algorithm code; 

a control to query the user for input and output 
parameter information; 

wherein the user interface is available to pass the 
algorithm source code to an evaluation process, the evaluation 
process being available to determine whether the user has 
properly implemented interface requirements; and 

wherein the user interface is available to pass the 
algorithm source code to a wrapping process that wraps the 
algorithm in an appropriate language-specific accessor 
function . 

2. The user interface according to claim 1 wherein the 
algorithm source code is written in a high level-language. 

3. The user interface according to claim 2 wherein the high- 
level language is selected from the group consisting of C, 
C++, Java, Matlab, Fortran, Pascal, and Visual Basic. 

4. The user interface according to claim 1 wherein the control 
to upload an algorithm source code is a single control 
element . 

5. The user interface according to claim 1 wherein the control 
to upload an algorithm source code is a plurality of elements 
comprising a text box in which to identify a file, a browse 
button with which to select a file, and an upload button with 
which to initiate the upload process. 

6. The user interface according to claim 1 wherein the input 
and output parameter information comprises data format, 
default values, help dialogs, and parameter relationships. 
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7 . The user interface according to claim 1 wherein the 
interface requirements checked by the evaluation process 
include an entry point into the code and exit state. 

8 . The user interface according to claim 1 wherein the wrapping 
5 process is a back-end procedure. 

9. A method for inserting a custom algorithm in a data-mining 
application, the method comprising: 

uploading an algorithm source code; 

receiving input and output parameter information from the 

10 user; 

evaluating the algorithm source code to determine whether 
!Nj the user has properly implemented interface requirements; and 
passing the algorithm source code to a wrapping process 

5 -A f that wraps the algorithm in an appropriate language-specific 

SI 

\d 15 accessor function. 

H- 

M= 10. The method for inserting a custom algorithm in a data- 

%. mining application according to claim 9 wherein the algorithm 

|i| source code is written in a high level-language. 

11. The method for inserting a custom algorithm in a data- 
20 mining application according to claim 10 wherein the high- 
level language is selected from the group consisting of C, 
C++, Java, Matlab, Fortran, Pascal, and Visual Basic. 

12. The method for inserting a custom algorithm in a data- 
mining application according to claim 9 wherein the processes 

25 are tied to a user interface. 

13. The method for inserting a custom algorithm in a data- 
mining application according to claim 9 wherein processes are 
performed by a separate application. 

14. The method for inserting a custom algorithm in a data- 
30 mining application according to claim 9 wherein the input and 

output parameter information comprises data format, default 
values, help dialogs, and parameter relationships. 
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15. The method for inserting a custom algorithm in a data- 
mining application according to claim 9 wherein the interface 
requirements evaluated include an entry point into the code 
and exit state. 

16. The method for inserting a custom algorithm in a data- 
mining application according to claim 9 wherein the wrapping 
process is a back-end procedure. 

17. An interface for inserting a customer algorithm into a 
data-mining application, the interface comprising: 

a means for uploading an algorithm source code; 

a means for receiving input and output parameter 
information from the user; 

a means for evaluating the algorithm source code to 
determine whether the user has properly implemented interface 
requirements; and 

a means for passing the algorithm source code to a 
wrapping process that wraps the algorithm in an appropriate 
language-specific accessor function. 

18. The interface for inserting a custom algorithm in a data- 
mining application according to claim 17 wherein the algorithm 
source code is written in a high level-language. 

19. The interface for inserting a custom algorithm in a data- 
mining application according to claim 18 wherein the high- 
level language is selected from the group consisting of C, 
C++, Java, Matlab, Fortran, Pascal, and Visual Basic. 

20. The interface for inserting a custom algorithm in a data- 
mining application according to claim 17 wherein the means are 
contained in a user interface. 

21. The interface for inserting a custom algorithm in a data- 
mining application according to claim 17 wherein means are 
contained in a separate application. 
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22. The interface for inserting a custom algorithm in a data- 
mining application according to claim 17 wherein the input and 
output parameter information comprises data format, default 
values, help dialogs, and parameter relationships. 

5 23. The interface for inserting a custom algorithm in a data- 
mining application according to claim 17 wherein the interface 
requirements evaluated include an entry point into the code 
and exit state. 

24. The interface for inserting a custom algorithm in a data- 
10 mining application according to claim 17 wherein the wrapping 
process is a back-end procedure. 

?=; 25. An article of manufacture for inserting a customer 

fef algorithm into an analysis environment, comprising a computer 

Cj readable media containing: 

m 15 a computer program code segment that uploads an algorithm 

5=fe 

M- source code; 

% a computer program code segment that receives input and 

yj output parameter information from the user; 

O 

lj, a computer program code segment that evaluates the 

D 20 algorithm source code to determine whether the user has 

ni 

properly implemented interface requirements; and 

a computer program code segment that passes the algorithm 
source code to a wrapping process that wraps the algorithm in 
an appropriate language-specific accessor function. 
25 26. The article of manufacture for inserting a custom 

algorithm in a data-mining application according to claim 25 
wherein the algorithm source code is written in a high level- 
language . 

27. The article of manufacture for inserting a custom 
30 algorithm in a data-mining application according to claim 26 
wherein the high-level language is selected from the group 
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consisting of C, C++, Java, Matlab, Fortran, Pascal, and 
Visual Basic. 

28. The article of manufacture for inserting a custom 
algorithm in a data-mining application according to claim 25 
wherein the computer readable medium further comprises a user 
interface comprising the computer program code segments. 

29. The article of manufacture for inserting a custom 
algorithm in a data-mining application according to claim 25 
wherein computer program code segments are part of a separate 
application. 

30. The article of manufacture for inserting a custom 
algorithm in a data-mining application according to claim 25 
wherein the input and output parameter information comprises 
data format, default values, help dialogs, and parameter 
relationships . 

31. The article of manufacture for inserting a custom 
algorithm in a data-mining application according to claim 25 
wherein the interface requirements evaluated include an entry 
point into the code and exit state. 

32. The article of manufacture for inserting a custom 
algorithm in a data-mining application according to claim 25 
wherein the wrapping process is a back-end procedure. 

33. A data-mining computer system adapted for inserting a 
custom algorithm into the data mining application, comprising: 

an upload control that uploads an algorithm source code; 

a parameter control that receives input and output 
parameter information from the user; 

an evaluation process that evaluates the algorithm source 
code to determine whether the user has properly implemented 
interface requirements; and 

a wrapping process that wraps the algorithm in an 
appropriate language-specific accessor function. 
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34. The data-mining computer system according to claim 33 
wherein the algorithm source code is written in a high level- 
language . 

35. The data-mining computer system according to claim 34 
5 wherein the high-level language is selected from the group 

consisting of C, C++, Java, Matlab, Fortran, Pascal, and 
Visual Basic. 

36. The data-mining computer system according to claim 33 
further comprising a user interface comprising the upload 

10 control and the parameter control. 

37 . The data-mining computer system according to claim 33 
p wherein the upload control and the parameter control are 

=5; inputs for an application. 

38. The data-mining computer system according to claim 33 
M= 15 wherein the input and output parameter information comprises 

data format, default values, help dialogs, and parameter 
O relationships. 

w 

O 39. The data-mining computer system according to claim 33 

==, wherein the evaluation process evaluates an entry point into 

fU 20 the code and exit state. 

40. The data-mining computer system according to claim 33 
wherein the wrapping process is a back-end procedure. 

41. A client system adapted for inserting a custom algorithm 
into a data-mining application, the client system comprising: 

25 an upload control that uploads an algorithm source code; 

a parameter control that receives input and output 
parameter information from the user; 

an evaluation process link that can call an evaluation 
process available to evaluate the algorithm source code to 
30 determine whether the user has properly implemented interface 
requirements; and 
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a wrapping process link that can call a wrapping process 
available to wrap the algorithm in an appropriate language- 
specific accessor function. 

42. The client system according to claim 41 wherein the 

5 algorithm source code is written in a high level-language. 

43. The client system according to claim 42 wherein the high- 
level language is selected from the group consisting of C, 
C++, Java, Matlab, Fortran, Pascal, and Visual Basic. 

44. The client system according to claim 41 further 

10 comprising a user interface comprising the upload control and 
the parameter control. 

45. The client system according to claim 41 wherein the 
upload control and the parameter control each present a prompt 
to the user and receive user input. 

15 46. The client system according to claim 41 wherein the input 
and output parameter information comprises data format, 
default values, help dialogs, and parameter relationships. 

47. The client system according to claim 41 wherein the 
evaluation process evaluates an entry point into the code and 

20 exit state. 

48. The client system according to claim 41 wherein the 
wrapping process is a back-end procedure. 

49. A server system wherein a custom algorithm can be 
inserted into an analysis environment, the server system 

25 comprising: 

an upload control that uploads an algorithm source code; 

a parameter control that receives input and output 
parameter information from the user; 

an evaluation process link that can call an evaluation 
30 process available to evaluate the algorithm source code to 
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determine whether the user has properly implemented interface 
requirements; and 

a wrapping process link that can call a wrapping process 
available to wrap the algorithm in an appropriate language- 
5 specific accessor function. 

50. The server system according to claim 4 9 wherein the 
algorithm source code is written in a high level-language. 

51. The server system according to claim 50 wherein the high- 
level language is selected from the group consisting of C, 

10 C++, Java, Matlab, Fortran, Pascal, and Visual Basic. 

52. The server system according to claim 49 further 

O comprising a user interface comprising the upload control and 

... 

|g . the parameter control. 

= 1 53. The server system according to claim 4 9 wherein the 

|=l 15 upload control and the parameter control each present a prompt 

[ : to the user and receive user input. 

H 54. The server system according to claim 4 9 wherein the input 

w 

O and output parameter information comprises data format, 

j=i default values, help dialogs, and parameter relationships. 

20 55. The server system according to claim 4 9 wherein the 

evaluation process evaluates an entry point into the code and 
exit state. 

56. The server system according to claim 4 9 wherein the 
wrapping process is a back-end procedure. 
25 57. A computer data signal embodied in a carrier wave 

encoding a computer program for inserting a custom algorithm 
in a data-mining application, the computer program comprising 
instructions for performing the method of claim 9. 

58. The computer data signal embodied in a carrier wave 
30 encoding a computer program for inserting a custom algorithm 
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in a data-mining application according to claim 57, wherein 
the algorithm source code is written in a high level-language. 

59. The computer data signal embodied in a carrier wave 
encoding a computer program for inserting a custom algorithm 

5 in a data-mining application according to claim 58, wherein 
the high-level language is selected from the group consisting 
of C, C++, Java, Matlab, Fortran, Pascal, and Visual Basic. 

60. The computer data signal embodied in a carrier wave 
encoding a computer program for inserting a custom algorithm 

10 in a data-mining application according to claim 57, wherein 
the processes are tied to a user interface. 

M 

□ 61. The computer data signal embodied in a carrier wave 

encoding a computer program for inserting a custom algorithm 
'\J in a data-mining application according to claim 57, wherein 

y 15 processes are performed by a separate application. 

62. The computer data signal embodied in a carrier wave 

O encoding a computer program for inserting a custom algorithm 
f§ in a data-mining application according to claim 57, wherein 

the input and output parameter information comprises data 
fy 20 format, default values, help dialogs, and parameter 

relationships . 

63. The computer data signal embodied in a carrier wave 
encoding a computer program for inserting a custom algorithm 
in a data-mining application according to claim 57, wherein 

25 the interface requirements evaluated include an entry point 
into the code and exit state. 

64. The computer data signal embodied in a carrier wave 
encoding a computer program for inserting a custom algorithm 
in a data-mining application according to claim 57, wherein 

30 the wrapping process is a back-end procedure. 

65. A method of providing a ground truth tool in a database 
having data fields, comprising: 
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processing to detect, to cluster, and to track contiguous 
events; 

presenting detected, clustered, and tracked contiguous 
events in groups wherein the members of each group have 
5 similar characteristics; and 

receiving input assigning class labels to the events. 

66. The method of providing a ground truth tool according to 
claim 65 wherein the processing is digital signal processing 
to detect, to cluster, and to track temporally contiguous 

10 events. 

67 . The method of providing a ground truth tool according to 

■jl claim 65 wherein the processing is image processing to detect, 

□ 

Q to cluster, and to track spatially contiguous events. 

\f 68. The method of providing a ground truth tool according to 

15 claim 65 further comprising storing the class labels in a new 
M data field appended the database. 

Q 69. The method of providing a ground truth tool according to 

£L claim 65 wherein events are presented and input is received on 

H- controls of a user interface. 

fy 20 70. A computer program storage medium readable by a computing 
system and encoding a computer program for providing a ground 
truth tool, the computer program comprising instructions for 
performing the method of claim 65. 

71. A computer program storage medium readable by a computing 
25 system and encoding a computer program for providing a ground 

truth tool, the computer program comprising instructions for 
performing the method of claim 66. 

72. A computer program storage medium readable by a computing 
system and encoding a computer program for providing a ground 

30 truth tool, the computer program comprising instructions for 
performing the method of claim 67. 
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73. A computer program storage medium readable by a computing 
system and encoding a computer program for providing a ground 
truth tool, the computer program comprising instructions for 
performing the method of claim 68 . 

74. A computer program storage medium readable by a computing 
system and encoding a computer program for providing a ground 
truth tool, the computer program comprising instructions for 
performing the method of claim 69. 

75. A computer data signal embodied in a carrier wave by a 
computing system and encoding a computer program for providing 
a ground truth tool, the computer program comprising 
instructions to perform the method of claim 65. 

76. A computer data signal embodied in a carrier wave by a 
computing system and encoding a computer program for providing 
a ground truth tool, the computer program comprising 
instructions for performing the method of claim 66. 

77. A computer data signal embodied in a carrier wave by a 
computing system and encoding a computer program for providing 
a ground truth tool, the computer program comprising 
instructions for performing the method of claim 67. 

78. A computer data signal embodied in a carrier wave by a 
computing system and encoding a computer program for providing 
a ground truth tool, the computer program comprising 
instructions for performing the method of claim 68. 

79. A computer data signal embodied in a carrier wave by a 
computing system and encoding a computer program for providing 
a ground truth tool, the computer program comprising 
instructions for performing the method of claim 69. 

80. A computer system having a data-mining application and 
including a ground truth tool, the system comprising: 

means for detecting, clustering, and tracking contiguous 
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means for presenting detected, clustered, and tracked 
contiguous events in groups wherein the members of each group 
have similar characteristics; 

means for receiving input assigning class labels to the 
events . 

81. The computer system according to claim 80 wherein the 
means for detecting, clustering, and tracking contiguous 
events is a digital signal processor to detect, to cluster, 
and to track temporally contiguous events. 

82. The computer system according to claim 80 wherein the 
means for detecting, clustering, and tracking contiguous 
events is an image processor to detect, to cluster, and to 
track spatially contiguous events. 

83. The computer system according to claim 80 further 
comprising a means for storing the class labels in a new data 
field appended the database. 

84. The computer system according to claim 80 wherein events 
are presented and input is received on controls of a user 
interface . 

85. A method for seamless insertion of custom algorithms in a 
data-mining application using tap points, the method 
comprising : 

using a computer system for machine-assisted problem 
exploration in a data-mining application, the computer system 
having a problem-definition user interface; 

concluding that additional operations are needed that are 
too complicated to be specified easily using the problem- 
definition interface; 

displaying to the user all data-mining steps and a tap- 
point dissemination helper; and 

receiving input from the user specifying when to extract 
an intermediate output for further processing. 
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86. The method according to claim 85 wherein the tap points 
are file-based. 

87. The method according to claim 85 wherein the tap points 
are not file-based. 

5 88. The method according to claim 85 wherein the machines- 
assisted problem definition uses a Bayesian network. 

89. The method according to claim 85 wherein the machines- 
assisted problem definition uses a decision tree. 

90. The method according to claim 85 wherein the displaying 
10 step and the receiving input step use a user interface. 

!==* 91 . The method according to claim 85 wherein user input 

D 

PI specifies the format in which data will output. 

92. A user interface adapted for specifying data tap-points 

Ul in a data-mining application, the interface comprising: 
y. 15 an output that displays information about the data-mining 

^ steps and a tap-point dissemination helper; and 
yj an input that receives information from the user to 

H specify when to extract an intermediate output for further 

O processing. 

m 

20 93. The user interface according to claim 92 wherein the 
output is a control on a user interface and the input is a 
control on a user interface. 

94. The user interface according to claim 92 wherein 
intermediate output is extracted at file-based tap points 

25 identified by the user. 

95. A computer readable medium comprising instructions for 
seamless insertion of custom algorithms in a data-mining 
application using tap points, said instructions comprising the 
acts of: 
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using a computer system for machine-assisted problem 
exploration in a data-mining application, the computer system 
having a problem-definition user interfaces- 
concluding that additional operations are needed that are 
5 too complicated to be specified easily using the problem- 
definition interfaces- 
displaying to the user all data-mining steps and a tap- 
point dissemination helper; and 

receiving input from the user specifying when to extract 
10 an intermediate output for further processing. 

96. The computer readable medium according to claim 95 
jHJ wherein the tap points are file-based. 

CI 97. The computer readable medium according to claim 95 
C.s wherein the tap points are not file-based. 

*15 98. The computer readable medium according to claim 95 
^ wherein the machines-assisted problem definition uses a 
□ Bayesian network. 

W 

p 99. The computer readable medium according to claim 95 

^ wherein the machines-assisted problem definition uses a 

f!J 20 decision tree. 

100. The computer readable medium according to claim 95 
wherein the displaying step and the receiving input step use a 
user interface. 

101. The computer readable medium according to claim 95 

25 wherein user input specifies the format in which data will 
output . 

102. A computer data signal embodied in a carrier wave and 
representing sequences of instructions which, when executed by 
a processor, cause said processor to seamlessly insert a 

30 custom algorithms in a data-mining application using tap 
points by performing the steps of: 
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using a computer system for machine-assisted problem 
exploration in a data-mining application, the computer system 
having a problem-definition user interface; 

concluding that additional operations are needed that are 
5 too complicated to be specified easily using the problem- 
definition interface; 

displaying to the user all data-mining steps and a tap- 
point dissemination helper; and 

receiving input from the user specifying when to extract 
10 an intermediate output for further processing. 

103. The computer data signal according to claim 102 wherein 
H the tap points are file-based. 

□ 104. The computer data signal according to claim 102 wherein 
r\ the tap points are not file-based. 

rf 15 105. The computer data signal according to claim 102 wherein 
H* the machines-assisted problem definition uses a Bayesian 

i=5 network. 

^ 106. The computer data signal according to claim 102 wherein 

M the machines-assisted problem definition uses a decision tree. 

U 20 107. The computer data signal according to claim 102 wherein 

the displaying step and the receiving input step use a user 

interface . 

108. The computer data signal according to claim 102 wherein 
user input specifies the format in which data will output. 

25 109. A computer system including means for seamless insertion 
of custom algorithms in a data-mining application using tap 
points, the computer system comprising: 

means for using a computer system for machine-assisted 
problem exploration in a data-mining application, the computer 

30 system having a problem-definition user interface; 
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means for concluding that additional operations are 
needed that are too complicated to be specified easily using 
the problem-definition interface; 

means for displaying to the user all data-mining steps 
5 and a tap-point dissemination helper; and 

means for receiving input from the user specifying when 
to extract an intermediate output for further processing. 

110. The computer system according to claim 109 wherein the 
tap points are file-based. 

10 111. The computer system according to claim 109 wherein the 
tap points are not file-based. 
Q 112. The computer system according to claim 109 wherein the 

y machines-assisted problem definition uses a Bayesian network. 

W 

,' J 113. The computer system according to claim 109 wherein the 

m 

M= 15 machines-assisted problem definition uses a decision tree. 

s 114. The computer system according to claim 109 wherein the 

J*f displaying means and the receiving input means comprise a user 

□ interface. 

!=* 

p 115. The computer system according to claim 109 wherein user 

hi 

'■- 20 input specifies the format in which data will output. 

116. A computer system including seamless insertion of custom 
algorithms in a data-mining application using tap points, the 
computer system comprising: 

a memory and a central processor; 
25 a machine-assisted problem exploration processor in a 

data-mining application; 

an output device, the output device communicating data- 
mining steps and a tap-point dissemination helper; when 
additional operations are needed that are too complicated to 
30 be specified easily using the machine-assisted problem 
exploration processor; and 
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an input device for receiving input from the user 
specifying when to extract an intermediate output for further 
processing. 

117. The computer system according to claim 116 wherein the 
output device is a member of the group consisting of a cathode 
ray tube and a printer. 

118. The computer system according to claim 116 wherein the 
input device is a keyboard. 
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